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Description 

METHOD FOR CONTROLLING 
INTERPOLATION DIRECTION AND 
RELATED DEVICE 

Background of Invention 
[0001] i. Field of the Invention 

[0002] The present invention relates to a method and device ca- 
pable of improving the accuracy of directional interpola- 
tion on object corners in an image, and more particularly, 
to a method and device for controlling an interpolation di- 
rection of a pixel needing to be interpolated. 

[0003] 2. Description of the Prior Art 

[0004] Traditional interpolation methods assume that a two- 
dimensional image to be interpolated consists of a plural- 
ity of one-dimensional images, and therefore, the two- 
dimensional image is interpolated vertically or horizon- 
tally. Such treatment may introduce unwanted zigzag 
edges of objects in the image. Some directional interpola- 



tion methods have been proposed to solve the above- 
mentioned problem. 
[0005] As shown in Fig. 1, the ELA algorithm (ref. T. Doyle and M. 
Looymans, Progressive scan conversion using edge infor- 
mation. In: L. Chiariglione, ed. Signal Processing of HDTV 
II, Elsevier Science Publishers B.V., North-Holland, pp. 
711-721, 1990) is typical of the directional interpolation 
methods known in the art. Firstly, a direction correspond- 
ing to a pair of pixels having a minimum difference be- 
tween their pixel values is selected from among three di- 
rections 131, 132, 133. The pixel values typically repre- 
sent brightness(luminance) and/or color(chrominance) 
levels of each pixel. For example, if the pixels 111, 123 
are similar and form a portion of an edge, the difference 
between the values of the pixels 111, 123 would be 
smaller than the difference between the values of pixels 
112, 122 and smaller than the difference between the val- 
ues of pixels 113, 121. Because of this, directional inter- 
polation should be performed along the direction 131. 
That is, the interpolated pixel 152 is derived from averag- 
ing the values of the pixels 111, 123. As shown in Fig. 2, 
pixels 201, 202, 203 are interpolated vertically while pix- 
els 211, 212, 213 are interpolated along an edge 215 of 



an object 210 of an interpolated image. The shading 
shown for each pixel in Fig. 2 denotes a hypothetical pixel 
value after interpolation. It is evident in this example that 
the zigzag edge problem is solved by using directional in- 
terpolation. For more information about variations of the 
ELA algorithm, please refer to U.S. Pat. No. 5, 742, 348 and 
U.S. Pat. No.6,133,957. 
[0006] However, the above-mentioned directional interpolation 
introduces a new problem of faulty treatment of object 
corners in the art. As shown in Fig. 3, pixels 301, 302, 303 
are interpolated along improper directions 311, 312, 313, 
respectively. The pixels 301, 302, 303 that should repre- 
sent a right-angle corner of an object 300 of an interpo- 
lated image are improperly interpolated. After interpola- 
tion, the above-mentioned right-angle corner substan- 
tially becomes a rounded corner. Similarly, the pixels 304, 

305, 306 are also improperly interpolated. 
Summary of Invention 

[0007] it j S therefore an objective of the present invention to pro- 
vide a method and a related device for controlling an in- 
terpolation direction of a pixel needing to be interpolated 
to solve the above-mentioned problem. Another objective 
of the present invention is performing a cross-detection 



process during/after a directional interpolation process to 
improve the accuracy of the directional interpolation on 
object corners in an image. 

[0008] The present invention provides a method for controlling 
an interpolation direction of a pixel needing to be inter- 
polated between a first row and a second row within an 
image. The image has a plurality of pixels arranged in a 
matrix format. According to one embodiment, the method 
includes calculating a plurality of first horizontal pixel dif- 
ferences between pixels positioned in the first row and a 
plurality of second horizontal pixel differences between 
pixels positioned in the second row. The first and second 
horizontal pixel differences respectively correspond to 
opposite quadrants of the image with the pixel being an 
origin. The method further includes comparing the plural- 
ity of first horizontal pixel value differences with a first 
threshold and the plurality of second horizontal pixel 
value differences with a second threshold to control 
whether the interpolation direction is orthogonal to the 
first row and the second row. 

[0009] The present invention further provides a device for con- 
trolling an interpolation direction of a pixel needing to be 
interpolated between a first row and a second row within 



an image. The image has a plurality of pixels arranged in 
a matrix format. According to the embodiment, the device 
includes an arithmetic unit for calculating a plurality of 
first horizontal pixel differences between pixels posi- 
tioned in the first row and a plurality of second horizontal 
pixel differences between pixels positioned in the second 
row.The first and second horizontal pixel differences re- 
spectively correspond to opposite quadrants of the image 
with the pixel being an origin. The device further includes 
a processing unit electrically connected to the arithmetic 
unit for controlling the interpolation direction. The pro- 
cessing unit compares the plurality of first horizontal 
pixel value differences with a first threshold and the plu- 
rality of second horizontal pixel value differences with a 
second threshold to control whether the interpolation di- 
rection is orthogonal to the first row and the second row. 

[0010] it is an advantage of the present invention method and 

device that the accuracy of the directional interpolation on 
object corners in the interpolated image is improved. 

[0011] These and other objectives of the present invention will no 
doubt become obvious to those of ordinary skill in the art 
after reading the following detailed description of the pre- 
ferred embodiment that is illustrated in the various fig- 



ures and drawings. 
Brief Description of Drawings 



[0012] pig.l is a hypothetical representation of a portion of an 
image interpolated by a directional interpolation method 
according to the prior art. 

[0013] pig. 2 is a hypothetical representation of a portion of an 

image interpolated by different interpolation methods ac- 
cording to the prior art. 

[0014] pig. 3 is a hypothetical representation of a portion of an 
image interpolated by a directional interpolation method 
according to the prior art. 

[0015] Fig. 4 is a flowchart illustrating steps of a method of pixel 
interpolation according to one embodiment of the present 
invention. 

[0016] Fig. 5 is a block diagram of a video processing device ac- 
cording to the embodiment. 

[0017] Fig. 6 is a first hypothetical representation of an arithmetic 
function applied to pixel data stored in a storage unit ac- 
cording to the embodiment. 

[0018] Fig. 7 is a second hypothetical representation of an arith- 
metic function applied to pixel data stored in a storage 
unit according to the embodiment. 

[0019] Fig. 8 is a third hypothetical representation of an arith- 



metic function applied to pixel data stored in a storage 

unit according to the embodiment. 
Detailed Description 



[0020] The present invention provides a method and device both 
for controlling an interpolation direction of a pixel need- 
ing to be interpolated between a first row and a second 
row within an image. The image has a plurality of pixels 
arranged in a matrix format, which is a two-dimensional 
array of pixels arranged in rows in the following embodi- 
ments. The method is capable of improving the accuracy 
of a directional interpolation process of the image,wherein 
an objective of the directional interpolation process is in- 
creasing the resolution of the image by generating a plu- 
rality of additional pixels. Please note that the interpola- 
tion process in the following embodiments can be based 
on the ELA algorithm, a variation of the ELA algorithm, or 
other directional interpolation algorithm as long as the 
implementation of the present invention will not be hin- 
dered. The present invention method is capable of gener- 
ating the interpolation direction corresponding to the 
pixel according to the directional interpolation process. 
Another objective of the present invention is performing a 
cross-detection process during/after the directional inter- 



polation process to improve the accuracy of the direc- 
tional interpolation on object corners in the image. 
[0021] please refer to Fig. 4, Fig. 5, Fig. 6 at the same time. Fig. 4 is 
a flowchart illustrating steps of a method according to one 
embodiment of the present invention. Fig. 5 is a block dia- 
gram of a video processing device 500 for implementing 
the method shown in Fig. 4. The video processing device 
500 includes a directional interpolation unit 510 for per- 
forming the directional interpolation process, a storage 
unit 520 for storing the data of the image, and a control 
device 530 having an arithmetic unit 530a and a process- 
ing unit 530p. Please note that the arithmetic unit 530a 
and the processing unit 530p can be integrated into one 
single module being the control device 530. Furthermore, 
the arithmetic unit 530a and/or the processing unit 530p 
can be installed in the directional interpolation unit 510. 
The directional interpolation unit 510 is capable of gener- 
ating a temporary direction, and the control device 530 
outputs a corrected direction according to the pixel data, 
a portion of the image data, and the inclination of the 
temporary direction. Fig. 6 is a hypothetical representation 
of an arithmetic function "A" applied to pixel data stored 
in the storage unit 520 according to the embodiment. The 



arithmetic function "A" is provided by the arithmetic unit 
530a. In a first embodiment, the arithmetic function "A" 
calculates a horizontal pixel value difference between the 
values of two pixels as shown in Fig. 6. Of concern, the 
pixel values are typically values that represent the bright- 
ness(luminance) and/or color(chrominance) levels of each 
pixel. The method of the present invention is described as 
follows: 

[0022] step 410:Calculate a plurality of first horizontal pixel 
value differences |A5-A4|, |A5-A3|, |A5-A2|, |A5-A1|, 

between pixels (610, 611), (610, 612), (610, 613), 

(610, 614), positioned in the first row and a plurality 

of second horizontal pixel value differences |B5-B6|, 

|B5-B7|, |B5-B8|, |B5-B9|, between pixels (620, 621), 

(620, 622), (620, 623), (620, 624), positioned in the 

second row using the arithmetic unit 530a, wherein the 
first horizontal pixel value differences |A5-A4|, |A5-A3|, 

|A5-A2|, |A5-A1|, and the second horizontal pixel 

value differences |B5-B6|, |B5-B7|, |B5-B8|, |B5-B9|, 

correspond to opposite quadrants II, IV of the image, re- 
spectively, with pixel 605 being the origin. As defined in 
the arithmetic unit 530a and as shown in Fig. 6, the pixels 
610, 611, 612, 613, 614, and 620, 621, 622, 623, 



624, for deriving the plurality of horizontal pixel dif- 
ferences |A5-A4|, |A5-A3|, |A5-A2|, |A5-A1|, and 

|B5-B6|, |B5-B7|, |B5-B8|, |B5-B9|, with the arith- 
metic function "A" are selected from the image according 
to whether the temporary direction inclines to the left or 
to the right. For example, Fig. 6 illustrates the pixels ap- 
plied with the arithmetic function "A" when the temporary 
direction inclines to the left. 

[0023] step 420:lf any of the plurality of first horizontal pixel 
value differences |A5-A4|, |A5-A3|, |A5-A2|, |A5-A1|, 

is greater than a first threshold Tl, and any of the 

plurality of second horizontal pixel differences |B5-B6|, 

|B5-B7|, |B5-B8|, |B5-B9|, is greater than a second 

threshold T2, control the interpolation direction not to be 
orthogonal to the first and the second rows using the pro- 
cessing unit 530p. 

[0024] step 430:lf none of the first horizontal pixel differences 

|A5-A4|, |A5-A3|, |A5-A2|, |A5-A1|, is greater than 

the first threshold Tl or none of the second horizontal 

pixel differences |B5-B6|, |B5-B7|, |B5-B8|, |B5-B9|, 

is greater than the second threshold T2, control the inter- 
polation direction to be orthogonal to the first and the 
second rows using the processing unit 530p. 



[0025] For simplicity, the first threshold Tl and the second 

threshold T2 can both be equivalent to a common thresh- 
old T. As shown in Fig. 6, the pixels shown with circles are 
interpolated pixels while the pixels shown with squares 
are source pixels of the directional interpolation per- 
formed by the directional interpolation unit 510. The 
shading shown for each pixel denotes a hypothetical pixel 
value after interpolation. The values of the pixels of the 
first row of the image are labeled as pixel values AO, Al, 

A2, A3, All and the value of the pixels of a second 

row of the image are labeled as pixel values BO, Bl, B2, 

B3, Bll. For example, the pixel values Al, A2, A3, 

A4, A5 correspond to the source pixels 614, 613, 612, 
611, 610, respectively, and the pixel values B5, B6, B7, B8, 
B9 correspond to the source pixels 620, 621, 622, 623, 
624, respectively. A pixel 605 being interpolated is shown 
with a triangle. As derived from the directional interpola- 
tion unit 510, according to the image shown in Fig. 6, the 
temporary direction inclines to the left. To prevent the 
faulty treatment of object corners described previously for 
the prior art illustration in Fig. 3, the arithmetic unit 530a 
is capable of calculating the horizontal pixel differences 
|A5-A4|, |A5-A3|, |A5-A2|, |A5-A1|, and |B5-B6|, 



|B5-B7|, |B5-B8|, |B5-B9|, according to the pixel data 

of the image. The processing unit 530p is capable of 
comparing one of the horizontal pixel value differences 

|A5-A4|, |A5-A3|, |A5-A2|, |A5-A1|, and |B5-B6|, 

|B5-B7|, |B5-B8|, |B5-B9|, calculated by the arith- 
metic unit 520 with the threshold T to determine if the 
temporary direction is correct. The threshold T can be de- 
fined according to experimental results or derived in ad- 
vance from trial processes of various kinds of test images. 
If any of the horizontal pixel value differences |A5-A4|, 

IA5-A3 1 , IA5-A2 1 , |A5-A1|, is greater than the 

threshold T and any of the horizontal pixel differences 

IB5-B6I, |B5-B7|, |B5-B8|, |B5-B9|, is greater then 

the threshold T, the temporary direction, which represents 
that there is a leftward sloping edge, is correct. The pixel 
605 being interpolated should accordingly be interpolated 
along the temporary direction. Otherwise, the temporary 
direction is incorrect, and the pixel 605 being interpolated 
should be interpolated in the vertical direction. As edges 
of different slops detected by the directional interpolation 
unit 510 vary, the amount of the horizontal pixel value 
differences for detecting the edges varies. That is to say, 
the selection of the pixels for deriving the horizontal pixel 



value differences can be implemented according to the 
range of the slops detected by the directional interpola- 
tion unit 510. 

[0026] Supposing that the temporary direction inclines to the 

right, the present invention method and device according 
to the first embodiment operate similarly. If any of the 
horizontal pixel value differences |A5-A6|, |A5-A7|, 

|A5-A8|, |A5-A9|, is greater than the threshold T and 

if any of the horizontal pixel value differences |B5-B4|, 
I B5-B3 1 , | B5-B2 1 , | B5-B1 1 , is greater than the thresh- 
old T, the temporary direction, which represents that 
there is a rightward sloping edge, is correct. In this case, 
the pixel 605 being interpolated should accordingly be in- 
terpolated along the temporary direction. Otherwise, the 
temporary direction is incorrect, and the pixel 605 being 
interpolated should be interpolated in the vertical direc- 
tion. 

[0027] | n t he first embodiment, although Step 410 calculates the 
first horizontal pixel value differences |A5-A4|, |A5-A3|, 

|A5-A2|, |A5-A1|, through a repeated use of pixel 

610 with the other pixels 611, 612, 613, 614, posi- 
tioned in the first row and the second horizontal pixel dif- 
ferences |B5-B6|, |B5-B7|, |B5-B8|, |B5-B9|, through 



a repeated use of pixel 620 with the other pixels 621, 

622, 623, 624, positioned in the second row, this is 

not a limitation of the present invention. The processing 
unit 530p is capable of deriving various horizontal pixel 
value differences through the arithmetic unit 530a to per- 
form the comparison between one of the horizontal pixel 
value differences with a predetermined threshold such as 
the common threshold T. 
[0028] a second embodiment shown in Fig. 7 is similar to the first 
embodiment shown in Fig. 6 with an exception of the se- 
lection of the pixels for deriving the horizontal pixel value 
differences. In the second embodiment of the present in- 
vention, Step 410 calculates each of the first horizontal 
pixel value differences |A5-A4|, |A4-A3|, |A3-A2|, 

|A2-A1|, from adjacent pixels (610, 611), (611, 612), 

(612, 613), (613, 614), and calculates each of the 

second horizontal pixel value differences |B5-B6|, 

|B6-B7|, |B7-B8|, |B8-B9|, from adjacent pixels (620, 

621), (621, 622), (622, 623), (623, 624), In both 

embodiments, the plurality of pixels 610, 611, 612, 613, 

614, and 620, 621, 622, 623, 624, selected for 

deriving the horizontal pixel value differences are located 
within two adjacent rows of the image. Additionally, the 



plurality of pixels 610, 611, 612, 613, 614, and 620, 

621, 622, 623, 624, are located within two opposite 

quadrants II, IV of the image with the center of the two 
opposite quadrants II, IV being located at the pixel 605 
being interpolated. Please note, the above-mentioned two 
adjacent rows are referring to the rows of the image prior 
to the interpolation being performed. 

[0029] | n another embodiment, a combination of the first and 
second embodiment, Step 410 calculates the first hori- 
zontal pixel value differences |A5-A4|, |A5-A3|, |A5-A2|, 

|A5-A1|, through a repeated use of pixel 610 with 

the other pixels 611, 612, 613, 614, positioned in 

the first row as in the first embodiment and calculates 
each of the second horizontal pixel differences |B5-B6|, 

|B6-B7|, |B7-B8|, |B8-B9|, from adjacent pixels (620, 

621), (621, 622), (622, 623), (623, 624), 

[0030] a third embodiment shown in Fig. 8 is similar to the first 
embodiment shown in Fig. 6 with an exception that the 
third embodiment further considers pixel data CO, CI, C2, 

C3, Cll of a third row of the image and pixel data 

DO, Dl, D2, D3, Dll of a fourth row of the image to- 
gether with the pixel data AO, Al, A2, A3, All and 

B0, Bl, B2, B3, Bll mentioned in the first embodi- 



ment. In the third embodiment, all the plurality of pixels 

610, 611, 612, 613, 614, , 620, 621, 622, 623, 624, 

, 630, 631, 632, 633, 634, and 640, 641, 642, 

643, 644, for deriving the horizontal pixel value dif- 
ferences |A5-A4|, |A5-A3|, |A5-A2|, |A5-A1|, , 

|B5-B6|, |B5-B7|, |B5-B8|, |B5-B9|, , |C5-C4|, 

IC5-C3I, |C5-C2|, |C5-C1|, , and |D5-D6|, |D5-D7|, 

|D5-D8|, |D5-D9|, are located within four successive 

rows of the image. Please note, the above-mentioned four 
continuous rows are referring to the rows of the image 
prior to the interpolation being performed. According to 
the third embodiment, a revision of the related steps 410, 
420, 430 are listed as follows. 
[0031] step 410:Calculate a plurality of first horizontal pixel 
value differences |A5-A4|, |A5-A3|, |A5-A2|, |A5-A1|, 

between pixels (610, 611), (610, 612), (610, 613), 

(610, 614), positioned in the first row; a plurality of 

second horizontal pixel value differences |B5-B6|, 

|B5-B7|, |B5-B8|, |B5-B9|, between pixels (620, 621), 

(620, 622), (620, 623), (620, 624), positioned in the 

second row; a plurality of third horizontal pixel value dif- 
ferences |C5-C4|, |C5-C3|, |C5-C2|, |C5-C1|, 
between pixels (630, 631), (630, 632), (630, 633), 



(630, 634), positioned in a third row; and a plurality 

of fourth horizontal pixel differences |D5-D6|, |D5-D7|, 

|D5-D8|, |D5-D9|, between pixels (640, 641), (640, 

642), (640, 643), (640, 644), positioned in a fourth 

row. The calculations are performed using the arithmetic 
unit 530a, wherein the first horizontal pixel value differ- 
ences |A5-A4|, |A5-A3|, |A5-A2|, |A5-A1|, and the 

third horizontal pixel value differences |C5-C4|, |C5-C3|, 

|C5-C2|, |C5-C1|, correspond to quadrant II of the 

image with the pixel 605 being the origin; and the second 
horizontal pixel value differences |B5-B6|, |B5-B7|, 

|B5-B8|, |B5-B9|, and the fourth horizontal pixel 

value differences |D5-D6|, |D5-D7|, |D5-D8|, |D5-D9|, 

correspond to the opposite quadrant IV of the image. 

Similarly, as defined in the arithmetic unit 530a and as 
shown in Fig. 8 together with Fig. 6, the pixels 610, 611, 

612, 613, 614, and 620, 621, 622, 623, 624, 

and 630, 631, 632, 633, 634, and 640, 641, 642, 

643, 644, for deriving the plurality of horizontal pixel 

differences |A5-A4|, |A5-A3|, |A5-A2|, |A5-A1|, and 

|B5-B6|, |B5-B7|, |B5-B8|, |B5-B9|, and |C5-C4|, 

IC5-C3I, |C5-C2|, |C5-C1|, and |D5-D6|, |D5-D7|, 

|D5-D8|, |D5-D9|, with the arithmetic function "A" 



are selected from the image according to whether the 
temporary direction inclines to the left or to the right. For 
example, Fig. 8 together with Fig. 6 illustrate the pixels ap- 
plied with the arithmetic function "A" when the temporary 
direction inclines to the left. 

[0032] step 420:lf any of the plurality of first horizontal pixel 
value differences |A5-A4|, |A5-A3|, |A5-A2|, |A5-A1|, 

is greater than a first threshold Tl, and any of the 

plurality of second horizontal pixel value differences 

|B5-B6|, |B5-B7|, |B5-B8|, |B5-B9|, is greater than a 

second threshold T2, and any of the plurality of third hor- 
izontal pixel value differences IC5-C4 1 , |C5-C3|, |C5-C2|, 

IC5-C1 1 , is greater than a third threshold T3, and any 

of the plurality of the fourth horizontal pixel differences 

|D5-D6|, |D5-D7|, |D5-D8|, |D5-D9|, is greater than 

a fourth threshold T4, control the interpolation direction 
not to be orthogonal to the first, second, third, and fourth 
rows using the processing unit 530p. 

[0033] step 430:lf none of the first horizontal pixel value differ- 
ences |A5-A4|, |A5-A3|, |A5-A2|, |A5-A1|, is greater 

than the first threshold Tl, or none of the second hori- 
zontal pixel value differences |B5-B6|, |B5-B7|, |B5-B8|, 
|B5-B9|, is greater than the second threshold T2, or 



none of the third horizontal pixel value differences 

|C5-C4|, IC5-C3I, |C5-C2|, |C5-C1|, is greater than 

the third threshold T3, or none of the fourth horizontal 
pixel value differences |D5-D6|, |D5-D7|, |D5-D8|, 

I D5-D9I , is greater than the fourth threshold T4, 

control the interpolation direction to be orthogonal to the 
first, second, third, and fourth rows using the processing 
unit 530p. 

[0034] | n order to reduce calculation complexity of the present 
invention method and device, the calculations and the 
comparisons relating to some of the plurality of horizontal 
pixel differences |A5-A4|, |A5-A3|, |A5-A2|, |A5-A1|, 

and |B5-B6|, |B5-B7|, |B5-B8|, |B5-B9|, and 

|C5-C4|, IC5-C3I, |C5-C2|, |C5-C1|, and |D5-D6|, 

|D5-D7|, |D5-D8|, |D5-D9|, can be omitted. In the 

fourth embodiment of the present invention, only the hor- 
izontal pixel differences |A5-A4|, |A5-A2|, and 

|B5-B6|, |B5-B8|, and |C5-C4|, |C5-C2|, and 

|D5-D6|, |D5-D8|, are considered. In the fifth em- 
bodiment of the present invention, only the horizontal 

pixel differences |A5-A4|, |A5-A2|, and |B5-B6|, 

|B5-B8|, and |C5-C3|, |C5-C1|, and |D5-D7|, 

I D5-D9I , are considered. In other variations of the 



present invention, simplified calculation of the plurality of 
horizontal pixel differences may be applied. 

[0035] The method and the device of the present invention can 
detect improper interpolation directions generated by the 
directional interpolation unit so the present invention 
method and device improve the accuracy of the directional 
interpolation on object corners in the interpolated image. 

[0036] Those skilled in the art will readily observe that numerous 
modifications and alterations of the device may be made 
while retaining the teachings of the invention. Accord- 
ingly, the above disclosure should be construed as limited 
only by the metes and bounds of the appended claims. 



